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To  you  who  are  concerned, 

Massachusetts  has  substance  abuse  prevention  programs  of 
many  kinds  up  and  running  in  virtually  every  community  in  the 
state.   Millions  of  dollars  and  countless  hours  are  being 
expended  in  this  essential  struggle. 

While  there  is  no  doubt  that  lives  and  human  suffering  are 
being  spared  as  a  result  of  this  effort,  an  important  set  of 
questions  must  be  continually  raised:   How  many  lives?   How 
much  suffering? 

Our  capacity  to  effectively  continue  substance  abuse 
prevention  programs  depends  largely  on  how  well  we  can  answer 
these  questions.   Only  by  being  able  to  track  substance  abuse 
patterns  over  time  can  we  measure  the  effectiveness  of  our 
efforts.   Only  by  being  able  to  detect  changes  which  occur  when 
programs  are  introduced  are  we  able  to  make  intelligent 
adjustments  to  further  our  goals. 

In  short,  good  prevention  requires  accurate  feedback. 

The  purpose  of  this  guide  is  to  provide  reliable, 
cost-effective  means  to  capture  this  information.   Collected 
here  are  pathways  which  will  lead  program  evaluators  to 
essential  data. 

The  Governor's  Alliance  Against  Drugs  has  the  highest 
regard  for  the  people  and  programs  against  substance  abuse 
which  have  made  our  state  a  national  leader  in  this  field.   We 
are  pleased  to  be  able  to  provide  these  evaluative  tools,  which 
can  only  build  a  stronger  effort,  wherever  they  are  applied. 


U)cd/^^> 


Jeorgette  Watson 
Executive  Director 
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INTRODUCTION 
Objective 

Today  almost  all  Massachusetts  communities  have  undertaken 
alcohol  and  drug  abuse  prevention  programs  in  order  to  reduce  the 
level  of  substance  abuse  among  residents,  particularly  school  age 
youth.   Many  of  the  programs  involve  community-wide  coalitions; 
some  are  quite  large  in  scope  and  are  supported  by  outside 
funding  sources.   To  date,  eight  Massachusetts  communities  have 
been  awarded  grants  from  the  Office  of  Substance  Abuse  Prevention 
of  the  Department  of  Health  and  Human  Services  to  develop  such 
programs:   Boston,  Gloucester,  Haverhill,  Lowell,  New  Bedford, 
Salem,  Springfield,  and  the  tri-county  consortium  in  Western 
Massachusetts.   An  additional  five  are  in  the  process  of 
receiving  funds:   Cambridge,  Holyoke,  Lawrence,  Lynn,  and 
Somerville.   Worcester  has  acquired  a  similar  grant  from  the 
Robert  Wood  Johnson  Foundation,  and  six  other  communities  in 
Massachusetts  have  applied  for  OSAP  support  in  the  next  round  of 
funding. 

Throughout  the  United  States,  interest  in  preventing 
substance  abuse  is  high.   National  public  opinion  surveys 
indicate  that  drug  abuse  is  viewed  as  one  of  the  three  most 
urgent  domestic  problems.   Whether  or  not  they  are  conducting 
large-scale  prevention  programs,  communities  need  to  assess  the 
nature  and  extent  of  drug  and  alcohol  problems  among  residents. 
This  can  be  accomplished  by  utilizing  readily  available  data  to 
serve  as  'indicators'  of  substance  abuse.   Such  an  indicator 


profile  could  be  used  in  many  ways:   to  track  substance  abuse 
trends  in  general;  to  detect  changes  which  occur  when  programs 
are  inaugurated;  and  to  evaluate  the  long-term  effects  of  these 
programs . 

Prevention  Programs 

Although  specific  programs  vary  in  detail  and  scope  from 
community  to  community,  all  share  the  common  goal  of  reducing 
drug  and  alcohol  use.   Indeed,  most  maintain  certain  common 
elements  in  philosophy  and  focus.   A  review  of  the  literature  on 
community-  and  school-based  prevention  plans  indicates  a 
historical  shift  in  orientation  from  short-term  informational  and 
affective  models  to  longer-term  and  more  comprehensive  agendas. 
The  earlier  models  were  based  on  a  belief  that  people  used 
alcohol  and  drugs  because  of  an  ignorance  of  their  effects,  low 
self-esteem,  or  poorly  developed  decision-making  skills.   Earlier 
prevention  strategies  concentrated  on  increasing  knowledge 
regarding  substance  use,  bolstering  young  people's  confidence, 
and  supporting  their  judgment  and  convictions.   However,  while 
overall  substance  use  has  decreased  sharply  in  the  school-age 
population,  these  specific  approaches  have  not  resulted  in 
quantifiable  changes  which  can  be  directly  attributed  to  the 
programs.   While  we  know  that  drug  use  has  declined,  we  cannot 
explain  why. 


Currently,  it  is  generally  recognized  that  varied  social 
pressures  surround  substance  use  and  that  resistance  to  these 
pressures  must  be  part  of  an  effective  strategy  for  eliminating 
alcohol  and  drug  problems  in  communities.   In  fact,  many  of  the 
latest  programs  include  the  letter  "R"  in  their  names, 
identifying  "resistance"  as  a  primary  focus  of  the  prevention 
curriculum:   Project  DARE  (Drug  Abuse  Resistance 

Education) (DeJong,  1987) ;  Project  STAR  (Students  Taught  Awareness 
and  Resistance) (Pentz,  1986);  and  Project  ALERT  (Adolescent 
Learning  Experiences  in  Resistance  Training) (Ellickson,  1988) . 

This  newer  social  influence  concept  acknowledges  the 
multitude  of  forces,  both  at  school  and  at  home,  involved  in  drug 
and  alcohol  problems.   It  sees  prevention  as  involving  more 
comprehensive  needs,  and  directs  efforts  at  the  convergence  of 
positive  messages  from  across  the  sectors.   There  has  been  a 
corresponding  shift  in  the  framework  further  away  from  a  strictly 
school-based  approach  to  one  that  links  the  school  with  parents 
and  community  resources.   In  fact,  today  a  comprehensive  agenda 
involves  all  the  important  "C's": 

*  community  involvement  in  all  phases; 

*  coordination  among  school,  neighborhood  and  citizen 
organizations ; 

*  communication  between  administrative  agencies,  service 
groups,  and  media; 

*  cooperation  between  supervisors  and  communities;  and 

*  commitment  to  involving  the  prevention  plan  with  the  life 
of  the  neighborhood. 


Goals  and  Organization 

Many  communities  in  the  United  States  have  begun  the  most 
difficult  task  of  evaluating  the  success  of  such  broad,  multi- 
dimensional strategies.   Although  limited  resources  are  often  a 
problem,  it  is  mandatory  to  examine  the  extent  to  which  these 
programs  are  working  and  to  determine  the  impact  of  the  program 
on  drug  and  alcohol  abuse.   Even  in  communities  without 
prevention  programs,  there  is  an  increasing  interest  in  assessing 
drug  and  alcohol  problems  in  order  to  understand  their  full 
impact  and  to  develop  interventions  in  the  future. 

An  examination  of  the  techniques  utilized  in  the  evaluation 
of  existing  programs  shows  that  there  are  a  limited  number  of 
methods  that  communities  can  use  to  assess  substance  abuse  trends 
over  time.   We  examined  the  major  evaluation  efforts  which  have 
been  viewed  as  national  models  by  federal  and  state  government 
administrators.   This  report  reviews  their  procedures, 
assimilating  and  adapting  the  best  and  simplest  components.   Over 
15  evaluations  were  studied  in  this  survey  and  are  included  for 
reference  in  the  bibliography. 

This  report  will  describe  a  Management  Information  System 
(MIS)  to  be  used  to  assess  prevention  program  implementation  and 
operation,  along  with  a  Community  Substance  Abuse  Profile  (CSAP) 
to  indicate  substance  abuse  trends  in  a  community.   The  important 
questions  that  are  answered  by  these  two  components  about  a 
community  drug  and  alcohol  prevention  program  are  "what  are  we 
doing?"  (the  process) ,  and  "what  have  we  accomplished?"  (the 


outcome) .   One  aim  of  this  report  is  to  select  those  indicators 
and  statistics  relevant  to  these  questions  which  are  readily 
available  to  most  planners  at  a  minimum  of  cost  and  effort.   The 
measures  suggested  in  this  evaluation  guide  represent,  in  large 
part,  the  wealth  of  data  that  is  routinely  collected  by  many 
organizations  concerned  with  alcohol  and  drug  problems. 


MEASUREMENTS 
Sources 

Evaluation  does  not  have  to  be  a  time  consuming  or  costly- 
process.   By  using  data  that  is  readily  available  or  already 
collected  by  other  groups,  managers  can  maximize  their  own 
resources  and  still  obtain  valuable  knowledge  of  abuse  trends  and 
of  program  effectiveness.   A  process  evaluation  can  be  completed 
by  keeping  adequate  written  records  as  a  program  is  developed, 
and  by  creating  and  routinely  using  standardized  forms.   Simply 
listing  each  program  activity  as  it  is  executed,  noting  the 
number  of  people  and  time  needed  to  run  it,  and  counting  those 
who  attend  provide  useful  measures  of  effort  and  involvement. 

While  the  process  appraisal  depends  more  on  information 
accumulated  within  the  agency  itself,  evaluations  of  outcome  and 
of  substance-related  problems  may  be  accomplished  primarily  by 
relying  on  external  sources.   We  live  in  a  society  that  routinely 
gathers  numerous  statistics.   Law  enforcement,  health  and  social 
service  bureaus  keep  databases  rich  with  material  applicable  to 
the  assessment  of  alcohol  and  drug  use  in  communities.   Most 
hospitals  maintain  uniform  patient  discharge  records  which 
indicate  diagnoses  of  conditions  related  to  alcohol  or  drug 
abuse.   Lists  of  admissions  to  substance  abuse  treatment  agencies 
may  provide  an  idea  of  the  extent  of  these  problems  in 
communities,  as  well  as  the  requests  for  intervention.   In 
addition,  crime  reports  and  arrest  data  indicate  frequencies  of 
alcohol  or  drug-related  offenses.   All  of  these  sources,  and 
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others,  can  be  tapped  by  evaluators,  both  as  indications  of  the 
trends  in  substance  abuse  over  time  and  as  helpful  comparisons 
with  prevalences  in  other  areas  and  communities. 

It  should  be  cautioned,  however,  that  each  measure  discussed 
may  reflect  something  other  than  what  is  obvious  only  at  the 
surface.   The  collection  of  statistics  often  depends  on  many 
extraneous  factors.   For  example,  arrest  data  may  indicate 
criminal  activity,  but  is  also  a  result  of  the  level  of  law 
enforcement  and  the  availability  of  enforcement  agents. 
Similarly,  treatment  statistics  are  an  indication  of  the  extent 
of  illness,  but  also  of  the  capacity  of  the  treatment  system. 
The  total  profile  of  indicators  needs  to  be  examined  for  an 
understanding  of  the  nature  and  scope  of  community  alcohol  and 
drug  problems. 

Suggested  Measurements 

The  following  is  a  summary  of  the  range  of  measures  that  can 
be  used  in  assessments  of  substance  use  trends  and  of  alcohol  and 
drug  prevention  programs.   All  have  been  used  by  one  or  more  of 
the  programs  that  we  reviewed  in  compiling  this  report.   It  may 
be  helpful  for  communities  to  examine  these  suggestions  together 
and  decide  upon  common,  useful  measures  that  should  be  tracked 
over  time  by  each  of  them.   In  fact,  much  could  be  gained  if  the 
OSAP  funded  project  communities  shared  conventional  program 
indicators.   Measures  for  the  MIS  and  CSAP  are  specified 
separately.   The  MIS  focuses  on  process  evaluation  and  suggests 


ways  of  compiling  useful  statistics  for  assessing  program 
implementation.   The  CSAP  includes  outcome  measures  which  are 
valid  for  establishing  baseline  figures,  for  estimating  follow-up 
values,  and  in  general,  for  gauging  substance  abuse  problems. 

The  Management  Information  System 

An  MIS  may  be  developed  to  answer  questions  regarding  the 
activities  undertaken  to  achieve  program  goals.   This  may  concern 
areas  such  as  effort  necessary  to  conduct  various  endeavors  and 
involvement  of  the  groups  for  whom  these  endeavors  were  targeted. 
The  following  is  meant  to  be  a  comprehensive  description  of  all 
aspects  of  a  process  evaluation.   Evaluators  are  encouraged  to 
choose  among  the  methods  listed  and  adapt  them  where  appropriate 
to  correspond  best  with  program  needs  and  resources.   There  is  no 
single  prescribed  way  to  collect  and  maintain  the  information 
described  below.   Decisions  regarding  such  matters  should  depend 
on  the  existing  office  system  and  procedures.   However,  some 
suggestions  are  provided  for  guidance  purposes  in  the  next 
section  on  evaluation  methods  and  in  Appendices  A  and  B. 

1  -  Effort  expended:   the  evaluator  should  maintain  a  record 
of  the  activities  pursued  by  the  program  and  the  amount  of 
work  needed  to  accomplish  them.   Relevant  information  could 
include: 

a)  projects-list  all  project  activities  performed  over 
the  time  period  studied 

b)  staff-specify  the  number  of  people  used  to  conduct 
each  activity 
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c)  volunteers-indicate  number  of  volunteers  utilized  by 
programs 

d)  hours-calculate  total  hours  worked  by  staff  and 
volunteers  during  each  project 

e)  materials-record  all  materials  necessary  for 
implementation  of  projects 

f)  cost-determine  total  cost  of  each  activity, 
including  materials  and  personnel 

2  -  Community  involvement:   it  is  important  to  understand 
how  many  people  are  participating  in  programs  and  activities 
as  well  as  who  those  people  are.   Important  features  may  be: 

a)  attendance-record  number  of  people  who  attended  or 
participated  in  functions  and  the  total  number  of  hours 
of  their  participation 

b)  demographics-note  age,  sex,  race,  socioeconomic 
status,  place  of  residence  of  participants 

3  -  Satisfaction:   evaluators  should  be  interested  in 
knowing  the  opinions  of  leaders  and  participants  regarding 
the  mechanics  and  success  of  program  implementation. 
Surveys  such  as  the  following  can  be  of  use: 

a)  participant  surveys  to  obtain  feedback  from 
attendees  on  satisfaction  with  programs,  simple 
questionnaires  can  be  administered  to  attendees  and 
participants  at  each  activity 

b)  leader  surveys-those  who  conducted  projects 
(internal  and  external  staff)  can  be  queried  concerning 
their  perceptions  and  satisfaction  with  the  program  and 
the  effectiveness  of  the  approach  used 

4  -  Communication :   evaluators  may  want  to  consider  the 

extent  of  contact  and  cooperation  fostered  by  the  program 

between  groups  involved  in  the  program. 

a)  referrals-indicate  number  of  clients/patients 
referred  to  self-help  and  treatment  centers  by  involved 
organizations 


b)  exchanges-note  quantity  of  information  (e.g., 
pamphlets)  exchanged  between  interested  parties  (a 
sample  questionnaire  is  provided  in  Appendix  B) 

5  -  Visibility:   an  important  part  of  program 

implementation  involves  the  extent  of  public  notice  given  to 

planned  events  and  program  concepts. 

a)  newspaper-count  newspaper  advertisements/articles 
pertaining  to  prevention  efforts 

b)  television-identify  number  of 

advertisements/telecasts  regarding  program  endeavors, 
this  may  include  both  public  and  private  (cable) 
networks 

c)  notices-list  number  of  flyers/announcements 
distributed  concerning  alcohol/drug  abuse  prevention 

d)  community  surveys-general  knowledge  of  both  program 
goals  and  events  should  be  included  as  items  in  any 
community  surveys  administered 


Community  Substance  Abuse  Profile 

The  CSAP  can  be  used  for  the  outcome  evaluation  of 
prevention  programs  to  learn  whether  program  goals  are  realized 
and  changes  in  substance  abuse  patterns  are  achieved.   The  CSAP 
is  also  of  value  in  communities  without  prevention  programs  for 
the  purposes  of  tracking  substance  abuse  trends  over  time.   The 
following  indicators  should  be  examined  periodically,  and,  in 
order  to  be  of  use  in  program  evaluation,  before,  during  and 
after  program  implementation. 

Individual  statistics  for  different  neighborhoods  and  ethnic 
groups  may  be  compared  to  understand  trends  according  to 
demographic  correlates  and  level  of  program  activity  or 
participation.   In  this  way,  these  indicators  can  also  help  to 
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identify  which  groups  in  the  community  are  being  reached  by 
prevention  efforts.   Furthermore,  the  total  CSAP  of  one  community 
can  be  related  to  other  communities  which  are  utilizing  different 
programs  to  compare  the  effectiveness  of  program  approaches. 
However,  all  of  these  indicators  should  take  into  account  the 
population  base  and  should  be  calculated  in  terms  of  population 
rates  and  not  absolute  numbers.   The  following  measures  comprise 
the  basic  parts  of  a  CSAP: 

1  -  Illness  patterns:  One  way  in  which  substance  abusers 
become  known  in  a  community  is  through  their  contact  with 
the  health  care  system. 

a)  treatment  for  substance  abuse-records  of  admissions 
to  treatment  centers  for  alcohol  or  drug  addiction  are 
maintained  by  the  Massachusetts  Department  of  Public 
Health,  Division  of  Substance  Abuse.   These  records  are 
analyzed  regularly  according  to  geographic  location. 

b)  substance  abuse-related  admissions  to  general 
hospitals-a  number  of  conditions  which  require  hospital 
treatment  are  related  to  substance  abuse.   These  can  be 
obtained  using  the  uniform  hospital  discharge  dataset, 

a  coded  diagnostic  record  kept  by  most  hospitals. 
Relevant  conditions  include  certain  diseases  of  the 
liver,  viral  hepatitis  B,  alcohol  dementia,  and  drug 
withdrawal  syndrome  (a  complete  list  of  applicable 
codes  has  been  compiled  by  the  Massachusetts  Department 
of  Public  Health  and  is  included  in  Appendix  F) . 
Demographic  information:   age,  race,  sex,  geographic 
location  of  patients  may  also  be  assessed  through  the 
discharge  data. 

c)  alcohol  or  drug  affected  births-infants  born  with 
drug  dependence  or  fetal  alcohol  syndrome  are 
registered  in  the  hospital  discharge  dataset  (codes  for 
these  diagnoses  are  also  included  in  Appendix  F) . 

d)  cautions-hospital  discharge  data  may  list  only  the 
most  obvious  cases  of  alcohol/drug  related  illnesses, 
also  demographic  data  is  sometimes  incomplete. 
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2  -  Death  patterns:   In  the  same  way  that  certain  illness 
patterns  may  represent  effects  of  substance  use  in  the 
community,  deaths  due  to  drug-  and  alcohol-related  causes 
can  help  enumerate  the  extent  of  abuse  among  residents. 

a)  associated  deaths-number  of  deaths  with  causes 
related  to  alcohol  or  drug  use  can  be  ascertained 
through  death  certificates,  or  by  statistics  kept  in 
the  Department  of  Public  Health,  Bureau  of  Health 
Statistics  (death  certificates  are  coded  similarly  to 
the  hospital  discharge  lists  and  the  codes  in  Appendix 
F  are  all  applicable) .   Demographic  information:   age, 
race,  sex,  geographic  location  of  deceased  may  be 
available  using  these  same  sources. 

b)  cautions-causes  of  death  attributable  to  substance 
abuse  are  often  missed  and  go  unreported  in  these 
sources. 

3  -  Criminal  activity:   another  way  to  measure  the  impact  of 
substance  abuse  in  the  community  is  to  examine  legal 
offenses  of  residents  associated  with  drug  and  alcohol  use. 

a)  court  filings-district  courts  maintain  estimates  of 
numbers  of  complaints  filed  for  driving  under  the 
influence,  narcotics  charges,  etc. 

b)  crime  reports-number  of  arrests  for  sale  and 
possession  of  drugs,  driving  under  the  influence,  drug- 
related  murders,  disorderly  conduct,  and  liquor  law 
violations  are  kept  by  US  Department  of  Justice, 
Federal  Bureau  of  Investigation,  Uniform  Crime 
Reporting  Program  (UCRP) ,  according  to  region  of 
arrest.   This  information  can  be  directly  accessed  by 
calling  UCRP  user  services,  (202)  324-5015. 

c)  accidents-accidents  caused  by  drug  or  alcohol  use 
are  registered  in  the  Fatal  Accident  Reporting  System 
kept  by  the  Department  of  Transportation.   Tapes  are 
available  with  data  including  location  of  accident, 
demographic  information  on  the  driver,  and  other 
pertinent  details.   A  sample  of  the  forms  used  to 
collect  findings  is  in  Appendix  G. 


d)  cautions-many  of  these  statistics  may  depend  on 
factors  such  as  patrol  time,  the  variable  attention 
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given  to  different  offenses,  and  incomplete  reporting. 
Also,  federal  listings  do  not  include  data  from  county 
sheriffs  or  state  police  but  only  from  local  law 
enforcement  agencies. 

4  -  Self  report:   the  community's  substance  use 

habits  may  be  individually  assessed  by  questioning  both 

prevention  program  participants  and  a  random  sample 

of  the  general  population  at  one  or  over  several  time 

periods. 

a)  surveys-program  effectiveness  can  be  assessed 
through  questionnaires  examining  reported  substance 
use,  both  in  activity  participants  themselves  and  in 
the  general  public.   Surveys  can  be  distributed  at 
specified  time  intervals  to  determine  trends  in  use  or 
one  can  ask  for  self-reports  of  behavior  modifications 
over  a  specific  time.   Both  the  federal  and  state 
governments  conduct  routine  surveys  of  drug  and  alcohol 
intake  in  regions  of  this  country  and  may  provide 
useful  comparisons  for  evaluation  programs.   In  order 
to  facilitate  such  comparisons,  prevention  programs  may 
want  to  model  their  surveys  after  the  government 
designs  (see  samples  in  Appendices  C  and  D,  and 
bibliography  for  references) . 
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METHODS 

Planning  an  Evaluation 

In  designing  an  evaluation,  it  is  important  to  understand 
the  strengths  and  limitations  of  any  assessment  system.   Although 
the  process  evaluation  is  critical  to  measuring  program 
implementation,  a  working  process  does  not  guarantee  that  the 
desired  effects  are  being  achieved.   The  outcome  evaluation, 
which  is  used  to  judge  such  concerns,  however,  is  not  sufficient 
by  itself.   Desired  effects  may  be  achieved  despite  an 
inefficient  system.   In  fact,  even  if  a  community's  rates  of 
substance  abuse  decrease  markedly,  these  changes  may  be  due  to 
factors  other  than  the  intervention,  e.g.,  an  overall,  national 
increase  in  alcohol  prices. 

The  basic  scientific  design  which  is  needed  to  establish 
that  a  community  program  has  produced  a  change  in  substance  use 
would  require  control  communities  without  a  program,  random 
assignment  of  some  communities  to  the  program,  and  adequate  pre- 
and  post-intervention  measures.   This  rigorous  type  of  evaluation 
can  only  be  conducted  on  a  national  level.   It  is  adequate,  for  a 
local  evaluation,  to  assess  appropriate  outcome  measures  over 
time.   However,  long-term  evaluations  are  usually  necessary  and 
should  be  provided  for,  especially  during  the  first  stages  of 
implementation,  in  order  to  represent  a  complete  picture  of  the 
trends  in  substance  use  associated  with  the  prevention  program. 
Often,  the  attention  given  to  abuse-related  problems  by 
prevention  programs  results  in  a  short-term  increase  in 
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prevalence  due  to  the  greater  perceived  need  for  services  and 
better  record-keeping  by  freshly  motivated  individuals. 

Doing  an  Evaluation 

In  this  part  of  the  report,  practical  suggestions  will  be 
given  for  designing  the  MIS  and  CSAP  components  of  an  evaluation 
system.   Depending  on  the  needs  of  the  particular  community 
involved,  different  aspects  may  be  emphasized  or  ignored.   Sample 
worksheets  and  statistics  that  may  give  further  direction  in 
collecting  the  necessary  information  are  provided  in  the 
appendices.   These  were  compiled  from  manuals  and  surveys  done  by 
the  Federal  Office  for  Substance  Abuse  Prevention  (OSAP,  1990, 
Linney,  1991),  the  Public  Health  Service  (DHHS,  1989,  1990)  and 
the  Massachusetts  Department  of  Public  Health  (McCarty,  1990) . 

The  evaluation  procedure  actually  begins  before  the 
prevention  program  has  been  initiated.   At  first,  it  is  necessary 
to  outline  the  goals  of  the  program,  so  that  appropriate  baseline 
measures  can  be  chosen  to  indicate  the  achievement  of  those  aims. 
Goals  should  be  as  specific  as  possible.   This  will  make 
selection  of  measures  easier  and,  ultimately,  more  appropriate  to 
real  program  needs.   A  worksheet  designed  by  OSAP  is  supplied  in 
Appendix  A  and  may  be  referred  to  for  guidance  in  launching  this 
aspect  of  the  evaluation. 
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The  Management  Information  System: 

The  MIS,  at  its  simplest,  will  be  a  detailed  documentation 
of  the  program's  activities.   Details  should  be  recorded  on 
program  operation:   publicity  applied,  staff  employed,  hours 
worked,  etc.   Note  should  be  made  of  any  changes  in  the 
anticipated  schedule  and  the  reasons  for  the  change.   In 
addition,  it  is  helpful  to  try  and  document  leader  and 
participant  reactions  as  a  way  of  understanding  exactly  what  was 
immediately  effective  and  why.   OSAP  worksheet,  step  two,  in 
Appendix  A  gives  one  possible  model  for  collecting  the  necessary 
information. 

The  Pawtucket  Heart  Health  Program  (PHHP) ,  a  community  plan 
to  prevent  cardiovascular  disease  also  supplies  some  ideas  for 
easily  generating  and  maintaining  process  data  (McGraw,  1989)  . 
Several  strategies  are  used  by  this  program.   Activity  files  are 
kept  containing  information  on  the  date,  place,  type,  and  nature 
of  each  activity,  along  with  the  number  of  participants.   An 
organization  file  tracks  each  group  that  is  associated  with  PHHP. 
A  contact  file  identifies  every  participant  in  PHHP  activities 
through  a  form  that  is  distributed  to  attendees  at  the  start  of 
each  project.   The  form  asks  for  the  age,  gender,  race,  residence 
and  any  other  relevant  material  the  person  is  willing  to  furnish. 
In  addition,  several  telephone  surveys  are  conducted  biannually 
both  with  associated  organizations  and  area  residents.   These 
question  people  on  risk  behaviors  and  perceptions  of  program 
activity.   Instructions  for  preparing  a  telephone  survey  are 
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provided  in  Appendix  E.   Of  course,  all  of  these  strategies  need 
not  be  implemented.   At  the  minimum,  the  following  features 
should  be  recorded: 

1)  Establish  goals- 

*  clearly  delineate  all  the  objects  of  the  prevention 
program; 

*  include  both  major  and  minor  ambitions. 

2)  List  activities  and  attention  allotted- 

*  make  and  maintain  a  list  of  the  important  activities 
of  each  project  goal  (revise  as  necessary  over  time, 
making  note  of  revisions) ; 

*  note  visibility  of  project  using  measurements  chosen 
above  (i.e.,  number  of  newspaper  advertisements); 

*  recognize  deficiencies  and  possible  improvements. 

3)  Identify  resources- 

*  note  people,  time  and  materials  needed  for  project 
implementation; 

*  indicate  any  adjustments  required. 

4)  Estimate  participation- 

*  focus  on  who  attended  sessions; 

*  observe  age,  sex,  and  ethnic  or  minority  groups 
represented; 

*  remark  any  deviations  from  anticipated  attendance; 

*  identify  ideas  for  improving  future  participation. 

5)  Assess  response  to  proiect- 

*  observe  leader  and  participant  enthusiasm; 

*  question  those  involved  when  possible; 

*  generate  feedback  for  better  success  in  prospective 
schedule. 

The  Community  Substance  Abuse  Profile: 

Ultimately,  any  prevention  program  needs  to  know  if  its 
initiatives  are  reducing  evidence  of  substance  use  in  the 
targeted  population.   Furthermore,  most  communities  should  be 
aware  of  drug  and  alcohol  abuse  by  their  residents  and  the  trends 
in  problems  associated  with  consumption.   Statistics  should  be 
observed  over  a  chosen  interval  (e.g. ,  every  six  months)  and  a 
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procedure  must  be  instituted  to  continue  tracking  these 
observations  throughout  the  life  of  the  program,  and  beyond. 
Numbers  should  be  contrasted  not  only  with  previous  time  periods 
but  also  with  other  communities  having  similar  demographic 
characteristics  and  absent  or  different  intervention  programs. 
This  may  give  an  idea  of  the  extent  of  change  in  the  CSAP,  and 
demographic  characteristics  related  to  the  change.   Records  must 
be  kept  separately  for  each  indicator  that  the  community  has 
decided  to  use.   Averages  and  rates  can  be  computed  by  looking  at 
total  population  in  an  area  compared  to  numbers  of  patients, 
deaths,  etc.   Tables  and  charts  may  be  generated  for  ease  of 
analysis  and  comparison.   The  samples  of  visual  aides  in 
Appendices  C  and  D  were  done  by  government  agencies  and  should 
provide  ideas  of  the  ways  this  data  can  be  collected,  analyzed 
and  presented. 
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APPENDICES 

The  following  forms  have  been  compiled  from  various 
evaluation  guides  written  by  federal  and  state  government 
agencies.   These  should  provide  assistance  to  evaluators  in 
designing  their  own  methods  for  data  collection  and  analysis 
throughout  the  evaluation  process.   The  specific  documents 
included  here  are: 

A)  Process  evaluation  worksheets,  from  Prevention  Plus  III 
manual  (Linney,  1991) . 

B)  Questionnaire  for  assessing  extent  of  communication 
between  involved  organizations  for  process  evaluation 
(Linney,  1991) . 

C)  Graphs  and  tables  for  outcome  evaluation,  from 
Indicators  of  Substance  Use  in  Massachusetts  (McCarty, 
1990) . 

D)  Graphs  and  tables  for  outcome  evaluation,  from  national 
surveys  (DHHS  1989,  1990). 

E)  Instructions  for  telephone  surveys  (Linney,  1991) . 

F)  International  Classification  of  Diseases  (ICD)  codes  of 
alcohol-  and  drug-related  diagnoses. 

G)  Fatal  Accident  Reporting  System  forms. 
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APPENDIX  A: 
PROCESS  EVALUATION  WORKSHEETS 


Source:   Linney  JA  and  Wandersman  A,   Prevention  Plus  III. 

Evaluating  Alcohol  and  Other  Drug  Prevention  Programs  at 
the  School  and  Community  Level:   A  Four  Step  Guide  to 
Useful  Evaluation.   2nd  Edition.   Rockville,  MD:   NCADI, 
1991.   (Draft) 
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STEP  1 :  identify  Goals  and  Desired  Outcomes 


Part  a)  Make  a  list  of  the  primary  goals  of  the  program.  Ask  yourself  "what  were 
we  trying  to  accomplish"?  Of  the  goals  listed,  check  the  ones  that  apply  to  your 
program  and  add  any  others  on  the  lines  provided. 


Part  b)  What  groups  did  you  WANT  to  involve?  Ask  yourself:  "Who  were  we  trying 
to  reach?"  Of  the  groups  listed,  check  the  ones  that  apply  to  your  program  and  add 
any  others  on  the  lines  provided. 

How  many  did 
Target  Group  you  want  to 

involve? 


Part  c)  What  outcomes  were  desired? 

Ask  yourself:  As  a  result  of  this  program  how  would  you  like  the  participants  to  have 
changed?  What  would  they  learn,  what  attitudes,  feeling  or  behavior  would  be 
different?  Of  the  outcomes  listed,  check  the  ones  that  apply  to  your  program  and  add 
any  others  on  the  lines  provided. 
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STEP  2:  Process  Evaluation  Worksheet 


^:?:.:. 


Part  a)  What  activities  were  planned? 

(Include  a  brief  description  of  the  components  of  the  program.  Ask  yourself:  What 
did  we  actually  do  to  prepare  lor  this  and  implement  ft?  Form  a  chronology  of  events 
constituting  this  program  and  a  quantity  indicator  for  each.) 


Activity 

Date 

Quantity 
Planned 

Quantity 
Actual 

^^^^^                  ^^^^^ 

Quantity  Totals: 
#  of  sessions 


(s)  length  of  time  for  each 


total  hours  of  activity  (s  x  h) 


.(h) 


What  written  materials  were  available?     Total  distributed 

manuals,  brochures 

"other 


Other  services  delivered: 


What  topics  or  activities  were  planned  but  were  not  covered? 
What  happened  that  these  did  not  get  accomplished? 
Activity  Problem 
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Part  b)  When  was  the  program  actually  Implemented  (dates  of  activities,  length  of 
time  for  each)  and  who  were  the  participants? 


Date 

Length  of  the 
activity 

%  of  time 
goal 

Attendance 

%  of  attendance 
goal 

I 

| 

J 

Total  # 

Totai  hrs 

%  of  goal 

Total  # 
(average  of 

all  sessions) 

1 

Who  was  missing  that  you'd  hoped  to  have  participate  in  the  program? 


What  explanations  can  be  offered  for  the  discrepancy  between  the 
projected  and  the  actual  participation? 


Part  c)  How  did  participants  evaluate  the  activities? 


Part  d)  What  feedback  can  be  used  to  Improve  the  program  for  the  future? 
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APPENDIX  B: 
QUESTIONNAIRE  FOR  PARTICIPATING  ORGANIZATIONS 


Source:   Linney  JA  and  Wandersman  A,   Prevention  Plus  III. 

Evaluating  Alcohol  and  Other  Drug  Prevention  Programs  at 
the  School  and  Community  Level:   A  Four  Step  Guide  to 
Useful  Evaluation.   2nd  Edition.   Rockville,  MD:   NCADI, 
1991.   (Draft) 
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Network  Analysis  Questionnaire  (M40) 

Dear < $ 

In  our  efforts  to  measure  how  drug-prevention  activities  are  being  coordinated  and 
implemented  in  your  community,  we  would  like  to  ask  you  to  assist  us  in  making  our  records 
more  complete. 

Attached  is  a  list  of  many  possible  agencies,  organizations,  groups,  and  individuals  that  mlatlt 
be  Involved  In  some  aspect  of  drug  prevention  -  at  the  State,  Regional/District,  and  Local 
levels.  Please  go  through  the  list  and  answer  the  three  questions  given  below  (and 
abbreviated  at  the  top  of  each  page),  for  as  many  of  the  listings  as  you  can.  You  need  to 
answer  Question  2  and  3  for  each  listing  only  if  you  are  able  to  answer  Question  1. 

This  task  should  take  about  10-15  minutes  -  thank  you  for  your  cooperation. 

Question  1:   If  you  know  the  person(s)  in  this  agency,  group,  or  role  (if  any)  who  is 
involved  in  drug  prevention /education,  please  write  their  name.  ONLY 
GIVE  NAMES  OF  PEOPLE  WHO  ARE  ACTIVELY  INVOLVED  IN 
DRUG  PREVENTION/EDUCATION  EFFORTS. 

Question  2:   How  many  times  have  you  talked  with  this  person  about  drug 
prevention/education  in  the  last  year? 

Question  3:   How  many  times  have  you  talked  with  this  person  about  drug 
prevention/education  in  the  last  month? 


PLEASE  COMPLETE  THE  FOLLOWING  INFORMATION: 

NAME:  

STATE:  


AGENCY: 


POSITION: 


NOTE:    ON  THE  FOLLOWING  PAGES,  IF  YOU  WANT  TO  GIVE  MORE  THAN 
CNE  NAME  FOR  ANY  LISTING,  PLEASE  WRITE  ON  BACK  AND 
ANSWER  THE  SAME  QUESTIONS  FOR  THEM. 
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STATE  LEVEL 


Name  of  person      Times  you  have 
involved  in  talked  to  in 

drug  prev/educ?     last  year? 


Times  you  have 
talked  to  in 
the  last  month? 


Governor 

i 

Director  of 
"Governor's 

Initiative" 

Attorney 
General's  Off 

U.S.  Senator 

Deptof 
Education 

School 
Superintendent 

DEA  Reduction 
Officer 

Dept  of  Justice 
Juvenile  Rep. 

Dept  of  Mental 
Health/Mental 
Retardation 

Coordinator  of 
DHR  or  Public 
Health  (A&D) 

State  Legislators 
or  Legislative 
Comm. 

Children's 
Council/  Sen/. 

College  of  Univ. 
Program 

State  PTA 
Chairperson 

State  School 
Board 

State  Highway/ 
Patrol 
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STATE  LEVEL 


Name  of  person    Times  you  have    Times  you  have 
Involved.  In  talked  to  In  talked  to  In 

drug  prev/educ?   last  year?  the  last  month? 


State  4-H  Office 

State  Boy  Scouts 
Office 

Civic/Service 
Assoc. 

Student 
Organizations 

Professional 
Organ. 

NEA  Student 
Affiliate 

■ 

Religious  Organ. 

Private  Sector 

Please  list  any 
additional  State 
Level  agency, 
group,  or  role, 
and  answer  the 
same  3 
questions: 
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REGIONAL/DIS- 
TRICT LEVEL 


Name  of  person    Times  you  have 
Involved  in  talked  to  In 

drug  prev/educ?   last  year? 


Times  you  have 
talked  to  In 
the  last  month? 


IKS.  Congress- 
person 

Educational 

Specialists 

(RESA) 

Private/Public 

Treatment 

Programs 

CADRE 

Additional 
Regional/  District 
Level: 

LOCAL  LEVEL 


Mayor 

City  Council- 
persons 

County  Council- 
persons 

School  Board 
Chair 

CADRE 

Superintendents 

Principals 

Counselors 

Curriculum 
Coordinator 
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APPENDIX  C: 
OUTCOME  EVALUATION 
INDICATOR  PROFILES 


Source:   McCarty  D,  Hofmann  MB,  Williams  CN,  Krakow  M,  Steriti  L, 
"Indicators  of  Substant  Use  in  Massachusetts." 
Massachusetts  Department  of  Public  Health,  Division  of 
Substance  Abuse  Services,  1990. 
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APPENDIX  D: 

OUTCOME  EVALUATION 

SURVEYS  OF  ATTITUDE  AND  BEHAVIOR 


Source:   Department  of  Health  and  Human  Services.   Drug  Use, 

Drinking,  and  Smoking:  National  Survey  Results  from  High 
School,  College,  and  Young  Adult  Populations  1975-1988. 
Washington  DC:   DHHS,  1989. 

Department  of  Health  and  Human  Services.   National 
Household  Survey  on  Drug  Abuse:  Highlights  1988. 
Washington  DC:  National  Institute  on  Drug  Abuse,  1990. 
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Trends  in  Proportion  of  Friends  Disapproving  of  Drug  Use 

Young  Adults  in  Modal  Age  Groups  of  19-22  and  23-26 


Percentage  saying  friend*  disapprove* 


Q.    How  do  you  think  your  close  friends 
feel  (or  would  feel)  about  you  ... 


Age 
Group 


1980   1981   1982   1983   1984   1985   1986   1987   1986 


change 


Trying  marijuana  once  or  twice 


Smoking  marijuana  occaaionally 


Smoking  marijuana  regularly 


19-22  41.0       40.6       46.9       47.1        51.6  54.5  55.2  54.7  58.7  +4.0 

23-26  47.7  47.0  49.1  53.9  582  +4.3 

19-22  50.9       49.2       54.0       57.9       59.4  64.6  64.4  65.1  69.8  +4.7 

23-26  54  J  56.4  57.1  63.1  68.1  +5.0 

19-22  70.3       75.2       75.7       79.5       80.0  82.7  83.5  84.8  86.9  +2.1 

23-26  77.8  78.4  80S  82.0  85.8  +3.8 


Trying  LSD  once  or  twice 


19-22  87.4       90.5       88.0       89.3       89.3       91.1       90.5       91.8       90.8 

23-26  87.4       90S       88.6       89.8       88.9 


■1.0 
■0.9 


Trying  cocaine  once  or  twice 


Taking  cocaine  occasionally 


19-22 
23-26 

19-22 
23-26 


NA         NA         NA         NA 


NA         NA         NA         NA 


NA 
NA 

NA 
NA 


NA 
NA 

NA 
NA 


76.4 
70.8 

84.9 

81.7 


NA 
NA 

NA 
SA 


84.8 
81.4 

91.0 
882 


NA 
NA 

NA 
NA 


Trying  an  amphetamine  once  or  twice 


19-22  75.8       76.7        75.3       74.3       77.0       79.7       81.5       31.3       83.0  *  1.7 

23-26  78.4       79.1       76.7       S1.7       83.0  +1.3 


Taking  one  or  two  drinks  nearly  every  day 


Taking  four  or  five  drinks  nearly  every  day 


Having  Ave  or  more  drinks  once  or  twice 
each  weekend 


19-22  71.9       72.1       68.6       73.5       71.6  72.2  72.7  70.2  73.9 

23-26  63.6  66.8  67.7  682  692 

19-22  93.7       91.7       89.9       91.9       91.7  92.5  91.5  90.8  90.4 

23-26  90  A  901  92  J  92.8  93.7 

19-22  53.5       51.7       51.7       53.3       50.8  53.3  47.0  49.4  50.5 

23-26  533  572  61.0  572  58.8 


+  3.7 
+  0.9 

-0.4 
-0.9 

+  1.1 
+  7.6 


Smoking  one  or  more  packs  of  cigarettes  per  day     19-22 

23-26 


Approx.  Wtd.  N 


75.6       75.1        75.4       "3.5       76.2       79.7       77.7       78.6       30.2 

73.9        77.3       80.3       a0.5        79.5 


19-22  (569)     (597)      (580)     (577)      (582)     (556)     (577)     (595)     (584) 

23-26  (510)     (548)     (549)     1540)     (510) 


♦1.6 
-1.0 


NOTE:       Level  of  significance  of  difference  between  the  two  most  recent  classes:  s  *  .05.  ss  ■  .01,  sss  *  .001.  A  blank  cell  indicates  data  not 
available. 

a Answer  alternative*  were:  (1)  Don't  disapprove,  (2)  Disapprove,  and  (3)  Strongly  disapprove.   Percentages  are  shown  for  categories  (2)  and  (3) 
combined. 
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Trends  in  Reported  Availability  of  Drugs 

Young  Ad u lis  in  Modal  Age  Groups  of  19-22  and  23-26 


Percentage  saving  "fairly  easy"  or  "very  casy"a 


Q.   How  difficult  do  you  think 
u  would  be  for  you  to 
get  each  of  the  following 
types  of  drugs,  if  you 
wanted  somei 

Marijuana 


Amyl  &  Butyl  Nitrites 


LSD 


PCP 


Some  other  psycnedeiic 


Cocaine 


Crack 


Cocaine  powder 


Heroin 


Some  other  narcotic 
(including  methadone) 


Amphetamines 


Barbiturates 


Tranquilizers 


Approx-  Wtd.  N 


Age 
Groun 


19-22 
23-26 

19-22 
23-26 

19-22 
23-26 

19-22 
23-26 

19-22 
23-26 

19-22 
23-26 

19-22 
23-26 

19-22 
23-26 

19-22 
23-26 


19-22 
23-26 

19-22 
23-26 

19-22 
23-26 

19-22 
23-26 

19-22 
23-26 


1980       1981       1982       1983 


95.6       91.1       92.4       89.7 


39.6       38.4       35.1       31.8 


42.1 
55.7 


37.7 
56.2 


33.5       31.0 


57.1 


55.2 


1984 

1985 

89.5 
88.8 

1986 

87.2 
88.8 

1937 

85.9 
903 

1988 

87.1 
863 

•87-'88 
chanee 

88.3 
92.5 

-1.2 
-3.4 

22.8 
23.1 

26.0 
28.0 

+  3.2 
+4.9 

32.7 
32.7 

29.6 
29.1 

30.5 
30.0 

29.9 
27.5 

33.9 
32.7 

+  4.0 

-52 

21.7 
212 

24.6 
27.6 

-13 
+6. 4s 

28.9 
31.8 

28.7 
29.6 

26.3 
26.4 

27.5 
25.6 

28.7 
29.6 

+  1.2 
+  4.0 

56.2 
63.7 

56.9 
6  7.2 

60.4 
65.5 

65.0 
69.0 

64.9 
7J.7 

-0.1 
+  2.7 

41.9 

■44.5 

47.3 
53.0 

+  5.4 
+  83ss 

58.7 
643 

60.2 
69.1 

+  1.5 
+  42 

17.2 
18.6 

20.8 
18.1 

21.2 
21.0 

24.4 
■  222 

28.5 
28.4 

+  4.1 

+  6. Is 

28.7 
323 

34.3 

32.1 

32.6 
33.6 

33.8 

322 

37.9 
353 

+  4.1 

+  3.7 

69.1 
653 

69.1 
66.0 

63.1 
64.5 

61.8 
652 

61.3 
622 

-0.5 

-3.1 

48.1 
52.7 

52.7 
4  7.7 

46.8 
46.4 

44.6 

453 

45.5 
4  7.4 

+  03 

+  13 

52.5 
602 

55.6 
54-3 

52.9 
54.1 

50.3 
563 

50.0 
523 

-0.3 
-33 

18.9       19.4       19.3       16.4 


32.7       32.4       30.8       31.0 


72.6       73.5       69.7 


59.5       61.1       56.8       54.2 


67.4       62.8       62.0       62.3 


(582)     (601)     (582)     (588)     (559)     (571)      (592)     (581)     (568) 

(540)     (541)     (548)     (539)     <526) 


NOTE:   Level  of  significance  of  difference  between  the  two  most  recent  classes:  s  3  .05,  ss  =  .01.  sss  *  .001.  A  blank  cell 
indicates  data  not  available. 

a Answer  alternatives  were:  (1)  Probably  impossible.  (2)  Very  difficult.  (3)  Fairly  difficult.  (4)  Fairly  easy,  and  (5)  Very  easy. 
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C.    Demographic  Differences  in  Past  Month  Alcohol  Use  (Figure  16) 

•  Males  were  significantly  more  likely  than  females  to  use  alcohol. 

•  Whites  were  significantly  more  likely  to  have  used  alcohol  in  the  past  month  than 
either  blacks  or  Hispanics.  and  Hispanics  were  significantly  more  likely  to  have 
used  alcohol  in  the  past  month  than  blacks. 

•  A  significantly  larger  percentage  of  those  in  large  metro  areas  used  alcohol  In 
the  past  month  than  those  in  small  metro  or  nonmetro  areas. 

•  Past  month  alcohol  use  in  the  South  was  significantly  lower  than  in  the  other 
three  regions. 


Figure  1 6.    Prevalence  of  Past  Month  Alcohol  Use  by  Demographic 
Characteristics:  1988 
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b.  Prevalence  by  Race/ 
Ethnicity 


Sourca:  NIDA.  National  Household  Survay  on  Drug  Abusa,  1988. 
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APPENDIX  E: 
INSTRUCTIONS  FOR  TELEPHONE  SURVEYS 


Source:   Linney  JA  and  Wandersman  A,   Prevention  Plus  III. 

Evaluating  Alcohol  and  Other  Drug  Prevention  Programs  at 
the  School  and  Community  Level:   A  Four  Step  Guide  to 
Useful  Evaluation.   2nd  Edition.   Rockville,  MD:   NCADI, 
1991.   (Draft) 
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Telephone  Surveys  (M41) 

Telephone  surveys  can  be  a  useful  way  to  get  information  and  ideas  from  the 
community.  There  are  several  places  in  this  Workbook  where  telephone  surveys  are 
suggested,  e.g.,  to  determine  how  a  program  is  perceived  by  citizens  or  to  measure 
awareness  of  a  particular  program. 

Telephone  surveys  don't  have  to  be  elaborate  to  be  useful  in  evaluation.  The  basic 
steps  are: 

1 .  Decide  who  you  want  to  talk  to,  parents  in  your  school,  residents  of  the 
neighborhood,  the  whole  community. 

2.  Draft  a  questionnaire  asking  the  information  you  are  interested  in  knowing.  Be 
sure  to  keep  the  language  straightforward  and  simple  because  people  will  need 
to  understand  the  question  when  they  hear  it  over  the  phone.  Try  to  keep  the 
whole  telephone  conversation  to  under  10  minutes. 

3.  Generate  a  pool  of  telephone  numbers  to  choose  from,  rf  your  group  of 
interest  is  the  parents  of  a  school,  the  school  may  have  those  telephone 
numbers.  If  you  are  interested  in  the  whole  community  you  might  use  the 
telephone  directory.  Choose  e  sample  of  the  telephone  numbers  on  your  list 
There  are  sophisticated  strategies  for  determining  how  to  choose  those 
numbers  and  how  many.  However,  for  our  purposes  it  may  be  sufficient  to 
take  every  tenth  number  on  the  list,  for  example.  You  should  determine  how 
many  calls  you  can  make  given  your  resources.  Suppose  you  can  handle  100 
calls  and  your  list  includes  2000  numbers.  Then  call  every  20th  number  on  the 
1st 

4.  Make  a  recording  sheet  for  each  number  to  be  called  so  that  the  caller  can 
write  down  the  answers  they  hear. 

5.  Write  a  standard  introduction  and  explanation  for  each  caller  to  describe  who 
you  are,  what  you  are  doing  and  why,  and  how  long  the  interview  will  take. 
Give  each  respondent  a  chance  to  say  "yes  I  will  participate,"  or  "no  I  dont 
want  to." 

6.  Recruit  callers/interviewers.  There  are  a  number  of  volunteer  groups  who  could 
make  the  calls  such  as  PTA  members,  or  student  groups.  Make  sure  that 
everyone  making  calls  is  pleasant  and  polite  on  the  phone. 

7.  Pilot-test  the  questionnaire  to  find  out  if  any  questions  are  ambiguous  or  not 
understandable  and  to  get  some  ideas  about  the  kind  of  responses  you  will  get 
Modify  the  questionnaire  based  on  this  pilot  test 

8.  Train  your  interviewers  in  using  the  questionnaire.  Have  them  practice 
interviewing  each  other. 

9.  Start  calling. 
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APPENDIX  F: 

INTERNATIONAL  CLASSIFICATION  OF  DISEASES 

DRUG  AND  ALCOHOL  RELATED  DIAGNOSES 


Source:   McCarty  D,  Hofmann  MB,  Williams  CN,  Krakow  M,  Steriti  L, 
"Indicators  of  Substant  Use  in  Massachusetts." 
Massachusetts  Department  of  Public  Health,  Division  of 
Substance  Abuse  Services,  1990,  from  Codes  for  surgical 
categories  from  the  International  Classification  of 
Diseases,  9th  Revision.  Clinical  Modification. 
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Saa  COCES  TOR  SUBSTANCE  USE  INDICATOR  PROJECT  AS  OF  1/17/Qn 
OSTO  TO  SEIECT  REtUktK  TOR  HUfciFiTAL  DISCHARGE  &  DEATH  DATASTTC 


070.2  Viral  hepatitis  B  with  hepatic  ccna 

070.3  Viral  hepatitis  B  without  mention  of  hep. 

265.2 

291.0  Alcohol  withdrawal  delirium 

291.1  Alcohol  amnestic  syndrom 

291.2  Other  alcohol  dementia 

291.2  Alcohol  withdrawal  hallucinosis 

291.4  Idiosyncratic  alcohol  intoxication 

291.5  Alcoholic  jealousy  (paranoia,  paranoid  psychosis) 

291.3  Other  specified  alcoholic  psychosis 
291.9  Unspecified  alcoholic  psychosis 

292.0  Drug  withdrawal  syndrome 

292.1  Paranoid  and/or  hallucinatory  states  induced  by  drugs 

292.2  Pathological  drug  intoxication 

292.3  Other  specified  drug-induced  mental  disorders 
292.9  Unspecified  drug-induced  mental  disorders 

292.11  Drug- induced  organic  delusional  sydrcme 

292.12  Drug- induced  hallucinosis 

292.31  Drug- induced  delirium 

292.32  Drug-induced  dementia 

292.33  Drug- induced  amnestic  syndrome 

292.34  Drug-indnrprt  organic  syndrome 

292.35  Drug-induced  organic  personality  sydrcme 

303.0  Acute  alcohol  intoxication 

303.9  Other  and  unspecified  alcohol  dependence 

304.0  Opioid  type  dependence 

304 . 1  Barb  and  similarly  acting  sedative. . . . 

304.2  Cocaine  Dependence 

304.3  Cannibis  dependence 

304.4  Amph  and  other  psycho-stiiaulant  dependence 

304.5  Hallucinogen  dependence 

304.6  Other  specified  drug  dependence 

304.7  Combinations  of. opioid  type  dependence  with  any  other  drug 
304.3  Combinations  of  drug  tipppnriencp  excluding  opioid  drug 
304.9  Unspecified  drug  dependence 
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305.0 
305.1 
305.2 
305.3 

305.4  BartD  and  similarly  acting  sedative  or  hypnotic  abuse 

305.5  Opioid  abuse 

305.6  Cocaine  abuse 

305.7  Amphetamine  or  related  acting  ■ympethoBJaatJ c  abuse 

305.8  Antidepressant  type  abuse 

305.9  Other,  mixed  or  unspecified  drug  abuse 

357.5  Alcoholic  polyneuropathy 

425.5  Alcoholic  cardianypathy 

535.3  Alcoholic  gastritis 

571.0  Alcoholic  fatty  liver 

571.1  Acute  alcoholic  hepatitis 

571.2  Alcoholic  cirrhosis  of  the  liver 

571.3  Alcoholic  liver  damage,  unspecified 

571.4  Chronic  hepatitis 

571.5  Cirrhosis  of  liver  without  mention  of  alcohol 

571.6  Biliary  cirrhosis 

571.8  Other  Chronic  nonalcoholic  liver  rHcaaca 

571.9  Unspecific  chronic  liver  dispose  without  mention  of  alcohol 

572.3  Portal  hypertension 

573.3  Hepatitis ,  unspecified 

760.71  Fetal  alcohol  syndrcme 

760.72  Fetal  disorder  —  narcotic  induced 

760.73  Fetus  disorder  —  hallucinogenic  agents  induced 

790.3  Excessive  level  of  blood  alcohol 
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965.00  Poisoning  by 

965.01  Pniscning  by  heroin 

965.02  Poisoning  by  methadone 

965 .t)9  Poisoning  by  other  analgesics,  antipyetics,  or  antileunatics 


967.0  Poisoning  by 

967.1  Poisoning  by  chloral  hydrate  group  substances 

967.2  Poisoning  by  paraldehyde 

967.3  Poisoning  by  bromine  compounds 

967.4  Poisoning  by  Methaqualone  compounds 

967.5  Poisoning  by  Glutethimide  group  substances 

967.6  Poisoning  by  Mixed  sedatives  not  elsewhere  classified 

967.8  Poisoning  by  other  sedatives  and  hynotics 

967.9  Poisoning  by  unspecified  sedatives  and  hypnotics 


968.5  Poisoning  by  surface  and  infiltration  anesthetics 

969.0  Poisoning  by  antidepressants 

969.1  Poisoning  by  phenothiazine-based  tranquilizers 

969.2  Poisoning  by  butyrophencne-based  tranquilizers 

969.3  Poisoning  by  other  anti-psychotic  and  neuroleptic  tranquilizers 

969.4  Poisoning  by  benzodiazepine  tranquilizers 

969.5  Poisoning  by  other  tranquilizers 

969.6  Poisoning  by  hallucinogens 

969.7  Poisoning  by  psychostimulants 

969.8  Poisoning  by  other  specified  psychotropic  agents 

969.9  Poisoning  by  unspecified  psychotropic  agents 


970.1  Poisoning  by  opiate  antagonists 

977.3  Alcohol  deterrents 

980.0  Ethyl  alcohol 

980.1  Methyl  alcohol 

980.2  Isoprcpyl  alcohol 

980.8  Other  specified  alcohol 

980.9  Unspecified  alcohol 

E850.0  Accidental  poisoning  by  heroin 

E850.1  Accidental  poisoning  by  Methadone 

E850.2  Accidental  poisoning  by  other  opiates  and  related  narcotics 

ES51  Accidental  poisoning  by  Barbiturates 
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£852.0  Accidental  poisoning  fay  chloral  hydrate  group  substances 

E852.1  Accidental  poisoning  by  paraldehhyde 

£852.2  Accidental  poisoning  by  bromide  compounds 

ES52.3  Accidental  poisoning  by  methaqualcne  compounds 

£852.4  Accidental  poisoning  by  glutethimide  group  substances 

£852.5  Accidental  poisoning  by  mixed  sedatives  not  mentioned 

£852.8  Accidental  poisoning  by  other  specified  sedatives/hynotics 

£852.9  Accidental  poisoning  by  unspecified  tranquilizers 

£853.0 
£853.1 
£853.2 
£853.8 
£853.9 

£854.0  Accidental  poisoning  by  psychotropic  agents 

£854.1  Accidental  poisoning  by  psychcdysleptics 

£854.2  Accidental  poisoning  by  psychostimulants 

£854.3  Accidental  poisoning  by  other  central  nervous  system  stimulants 

£855.2  Accidental  poisoning  by  local  anesthetics  (cocaine) 

£860.0  Accidental  poisoning  by  alcoholic  beverages 

£860.1  Other  ar.i  unspecified  ethyl  ale  and  its  products 

£860.2  Methyl  alcohol 

£860.3  Isopropyl  alcohol 

£860.8  Other  specified  alcohol 

£860.9  Unspecified  alcohol 

£950.0  Suicide  by  analgesics,  antipyretics,  and  antirheumatics 

E950.1  Suicide  by  barbiturate 

£950.2  Suicide  by  other  sedative  and  hypnotic 

£950.3  Suicide  by  tranquilizers  and  other  medicinal  substances 

£950.4  Suicide  by  other  specified  drugs  and  medicinal  substances 

£950.5  Suicide  by  other  unspecified  drugs  and  medicinal  substances 

Poisoning  with  undetermined  intention  fargrjripnrai  nr-  pirooselv  inflicted) 

£980.0  Poisoning  by  analgesics 

£980.1  Poisoning  by  barbiturates 

£980.2  Poisoning  by  other  sedatives 

£980.3  Poisoning  by  tranquilizers 

£980.4  Poisoning  by  other  specified  drug  or  medicinal  substance 

E980.5  Poisoning  by  othre  unspecified  drug  or  medicinal  substance 
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APPENDIX  G: 
FATAL  ACCIDENT  REPORTING  SYSTEM  FORMS 


Source:   FARS.  Fatal  Accident  Reporting  System.   U.S.  Department 
of  Transportation,  National  Highway  Traffic  Safety 
Administration,  DOT-HS-806-251,  1983. 
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100-A    EXHIBIT    FARS    CODING   FORMS     (VEHICLE/DRIVER   LEVEL) 


USOi 

DM 


AccMmm  W>o*wtwf  I«mm*  (MM) 
VEHICLE/DRIVER  LEVEL 


0  m  ■  n*  jtjr 
cootoar 

DAT!  cooio  _ 

5T4T|  CAM  MO 


iti    r     w     ■ 


CAM* 
JTATI 

•CSACOOfSt 


•     1 


nv« 


THAMACTVMCOOf 


71-0  !»■  K 

I-iMa 


»HTil 


i«  I  >»  | 


vt*«cia 


»)       »»*      I  •,  I  -I  J 


MOOKTiA* 


i  Ai:  2> 


vtMCU  WKtKiUTlWl  NO. 


2amfm*m<tm 


KMsraATOMSTAn 

staxntKM 


ala.yisiiini u 


b  i  »  l  ji  I  b  In  I  m  .  il  a 


i      i 
;  i;  i 


■      ,   - 


•0  1 


•ouovta 


»»-o  S  Qun   —  '••» 


JO— <A 
»7— *« 


0-M»< 
1  -»•■ 

1-W( 


a     .-Mi  m  i   ii  mill 


ACAUwl 

'■'■     Ml 


]      MMMltv 


tfS 


r*Av«t 


a    «* 


WWUMMomc— Q        „  : 


0-«a 


VIMCLI  TtHHM 


nt-« 


1-«M  nn«IM)il 


.  B-N*SaaBM« 

I  l-Ti. 


a.«ie2 
i-r» 
J-v« 

VaaiAvi 

!-¥*»*»  MR 


Sf*OA4UH 

>  4. 

1- 

•  «■ 
7. 

•  I- 


47  I 


:*rr      Li 


UM 


w 


:-■• 


.  H*  ACT  POBIT  -  WTVk 


4»  I    M    I 


9»  ti- 
ll-»• 

14. 


00-4MM 
O'U-O. 

ij-Taa 

14. 


'»«>ACT  romi  -  mwc»A4. 


H-Ui 

l«-C 


m 


uwv 


•-4M 
J-Oi 
•  -'« 


•-a* 

0-4*1 


H 


1-1 


I  it  I  MAA» 


|.IAJ»AHA  0*  lUWC  ACtX 


'    Wt 


0-M»« 


•  «•■■§  0M««  AA 


I* 


iu>iwo>oecu»AAm 


aUATOOACTDMS 


Sat* 


VftacUUVtl- 


□D 


|lTllt«4IHir¥W 


BUI 


host  mmmmm.  M*r 


Pf 


Cam 


I    <4 


I       t        '      QM4» 


u 


1TAT1         I  I 

j»ACQO0f   I 


NOVMIOl 

I 

•  •I 

4-C 


KUU  »f4T\jA 

i 

I.U 

I.  T, 


w 


-•vtd  ii-^Mi:  nrn 

|)M  Tta  OA4*  < 
■•  >M»  U*«M« 

i    M(  imw*  mm  ah  M> 

1  -M»  '—«  Oil  ■  —   !*•• 

I-  i4iinw*  f.«CK 


b 


oorxwtCKAAoio 


u^sksss.    p  **.«.. 


i— j  Acaowre 


r    a 


l  J- 

}-Aa 


oo-« 


•KeantOti 
■j«o  ■tvocAnaoa 


am 


mmjvioui  mwcomnmoMS 


at  m\ 


ma 


CT»4JA 


oati  o*  cait 


QATIO* 


J-L 


I  I  40  1  41  |  41  I  41  |    «« VAT10 
«A 


-0.-vt4ir.Tv 


F3 


I 


HS  farm  114A  <»•»    12/MI 


49 


100-A   EXHIBIT    FARS    CODING    FORMS     (ACCIDENT    LEVEL) 
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